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Abstract — We characterize the dynamical behavior of 
continuous-time, Markovian quantum systems with respect to a 
subsystem of interest. Markovian dynamics describes a wide class 
of open quantum systems of relevance to quantum information 
processing, subsystem encodings offering a general pathway to 
faithfully represent quantum information. We provide explicit 
linear-algebraic characterizations of the notion of invariant and 
noiseless subsystem for Markovian master equations, under dif- 
ferent robustness assumptions for model-parameter and initial- 
state variations. The stronger concept of an attractive quantum 
subsystem is introduced, and sufficient existence conditions are 
identified based on Lyapunov's stability techniques. As a main 
control application, we address the potential of output-feedback 
Markovian control strategies for quantum pure state-stabilization 
and noiseless-subspace generation. In particular, explicit results 
for the synthesis of stabilizing semigroups and noiseless subspaces 
in finite-dimensional Markovian systems are obtained. 

I. Introduction and Preliminaries 

Quantum subsystems are the basic building block for de- 
scribing composite systems in quantum mechanics [1]. From 
both a conceptual and practical standpoint, renewed interest 
toward characterizing quantum subsystems in a variety of 
control-theoretic settings is motivated by Quantum Informa- 
tion Processing (QIP) applications [2]. In order for abstractly 
defined QIP protocols to be useful, information needs to be 
represented by states of a physical system, in ways which 
minimize the impact of errors and decoherence due to the 
interaction of the system with its surrounding environment. 
Subsystem encodings provide the most general mathematical 
structure for realizing quantum information in terms of physi- 
cal degrees of freedom, and a main tool for achieving a unified 
understanding of strategies for quantum error control in open 
quantum systems [3], [4]. In particular, the idea that noise- 
protected subsystems may be identified in the overall state 
space of a noisy physical system under appropriate symmetry 
conditions underlies the method of passive quantum stabi- 
lization via decoherence-free subspaces (DFSs) [5], [6] and 
noiseless subsystems (NSs) [3], [7], [8]. In situations where 
no such symmetry exists, open-loop dynamical decoupling 
techniques can still ensure active protection through dynamical 
NS synthesis [9] in the non-Markovian regime. 

While substantial progress has been made toward defin- 
ing and exploiting subsystems within general quantum error 
correction theories (see also Section II-A), the subsystem 
notion and its implications have not yet reached out to the 
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quantum control community at large. It is one of the goals 
of this paper to take a step in this direction, by offering a 
linear- algebraic characterization of the subsystem idea, which 
allows easier contact with standard system-theoretic concepts 
such as invariance and stability. We focus on continuous-time 
Markovian quantum dynamics [10], which both accurately 
describes a wide class of open quantum systems and presents 
distinctive quantum stabilization challenges compared to its 
non-Markovian counterpart. In the process, we elucidate the 
key role played by different model robustness properties in 
ensuring that desired dynamical features may emerge, and in 
influencing the interplay between Hamiltonian and dissipative 
components. Beside leading to a streamlined derivation of 
Markovian DFS- and NS- conditions which have only partially 
appeared in the literature [8], [11], our analysis motivates the 
concept of attractive subsystem as a strategy for "dissipation- 
assisted" asymptotic initialization in an intended subsystem. 
As a main application of our work, we begin exploring the po- 
tential of Markovian, output-feedback techniques for the robust 
synthesis of pure states and NSs in finite-dimensional systems 
- complementing the above-mentioned open-loop dynamical 
schemes [9] as well as closed-loop feedback approaches using 
continuous-time state estimation [12]. 

A. Notations 

Consider a separable Hilbert space Ti over the complex field 
C. 23(H) represents the set of linear bounded operators on Ti, 
S)(Ti) denoting the real subspace of Hermitian operators, with 
I, O being the identity and the zero operator, respectively. 
We indicate with the adjoint of A G 23(H), with c* the 
conjugate of c G C. The commutator and anti-commutator 
of 1,7 G 23(H) are defined as [X, Y] := XY - YX, 
and {X, Y} := XY + YX, respectively. In the special case 
where H is two-dimensional, a convenient operator basis for 
the traceless sector of 23 (Ti.) is given by the Pauli operators, 
a ai a = x,y,z, satisfying [a a ,ap] = 2ie a /3 1 a 1 , {a a ,ap} = 
28 a pl, e,5 denoting the completely antisymmetric tensor and 
the Rronecker delta, respectively. We choose the standard rep- 
resentation where a x = ( ? J ) , a y = ( 9 ~* ) , a z = ( J _° x ) . 

Throughout the paper we shall use the Dirac notation [1]. 
Given the inner product ( , ) in Ti, a natural isomorphism 
exists between vectors in Ti (denoted \ip), and called a kef) 
and linear functionals in the dual space Ti* (denoted (ip\, and 
called a bra), so that (i/>\(p) = (il>,<p). If A e 23(H), letting 
A\ip) := A(ip) and (ip\A := (A* (*/>),•) yields (ip\A\tp) = 
(<p,A(ip)) = (A'(<t>), (p). The "outer" product IV'Xvl stands 
for (cp,-)ip G 23(H). Moreover, if |(V#)| = 1, |V>)(V>I = 
(ip,-)ip is the orthogonal projector onto the one-dimensional 
subspace spanned by 
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B. Basic notions of statistical quantum mechanics 

In the standard formulation of quantum mechanics [1], a 
quantum system Q is associated with a separable Hilbert 
space H, whose dimension is determined by the physics 
of the problem. Physical observables are modeled as self- 
adjoint operators on H, the set of possible outcomes they 
can assume in a von Neumann measurement process being 
their spectrum. In what follows, we consider only observables 
with finite spectrum, that can be represented as Hermitian 
matrices acting on H ~ C d , d < oo. Our (possibly uncertain) 
knowledge of the state of Q is condensed in a density operator 
p, with p > and trace (p) = 1, Density operators form a 
convex set D(H) C S)(H), with one-dimensional projectors 
corresponding to extreme points (pure states, piM — \ip)(ip\). 

If Q comprises two quantum subsystems Qi, Q2, the 
corresponding mathematical description is carried out in the 
tensor product space, H12 — Hi <8> H2 [1]> observables and 
density operators being associated with Hermitian, positive- 
semidefinite, normalized operators on H12, respectively. In 
particular, a joint pure state p 12 = | '0) 12 | which cannot 
be factorized into the product of two pure states on the 
individual factors is called entangled. Let X be an element 
of Q3(7ii2). The partial trace over H2 is the unique linear 
operator trace2(-) : 23(7ii2) — > <8(7ii), ensuring that for every 
Xi £ <B(Hi),X 2 G «8(W 2 ), ti-ace 2 (Xi®X 2 ) = Xitrace(X 2 ). 
If P12 represents the joint density operator of Q, the state of, 
say, subsystem Q\ alone is described by the reduced density 
operator pi = trace 2 (/9i2) 6 f)(7Yi), so that trace(piXi) = 
trace(pi2Xi ® I2), for all observables A\ G Sj(Hi). 

We consider quantum dynamics in the Schrodinger picture, 
with pure states and density operators evolving forward in 
time, and time-invariant observables. The evolution of an 
isolated (closed) quantum system is driven by the Hamiltonian, 
H, according to the Liouville-von Neumann equation: 

j t p{t) = -i[H,p{t)], 

in units where H = 1. Thus, p(t) = Utp(0)U^ , where the 
unitary evolution operator (or propagator) Ut = e~ lHt . 

In general, in the presence of internal couplings, quantum 
measurements, or interaction with a surrounding environment, 
the evolution of a subsystem of interest is no longer unitary 
and reversible, and the general formalism of open quantum 
systems is required [13], [10], [14]. The physically admissible 
discrete-time evolutions for a quantum system may be char- 
acterized axiomatically and are called quantum operations, or 
completely positive (CP) maps [15]. Let T denote the physical 
quantum system of interest, with associated Hilbert space Hi, 
dim(Hi) = d. The class of trace-preserving (TP) quantum 
operations is relevant to our purposes: 

Definition 1 (TPCP map): A TPCP-map T(-) on J is a 
map on D(Hi), that satisfies: 

(i) T(-) is convex linear: given states pi £ D(Hi), 

^(y^PiPi) = *YliPiT(Pi)> ^2,Pi = !' ^ °J Vi ; 

i i i 

(ii) T(-) is trace-preserving: 

trace(T(p/)) = trace(/9/) = 1; 



(iii) T(-) is completely positive: 

T{ Pl )>0, (I m ®T)(piE)>0, 

for every m-dimensional ancillary space He joint to Hi, 
and for every pi E € ®(Hi <S> He) Q 

A more concrete characterization of the dynamical maps of 
interest is provided by the following: 

Theorem 1 (Hellwig-Kraus representation theorem): T[-\ 
is a TPCP map on I iff for every pi £ D(Hi): 

T{pi)=Y,E kP iEl 

k 

where {Ek} is a family of operators in *B(Hi) such that 

As a consequence of the above Theorem, every TPCP map 
T(-) on 33 (Hi) may be extended to a well-defined linear, 
positive, and TP map on the whole *B(Hi). 

C. Quantum dynamical semigroups 

A relevant class of open quantum systems obeys Markovian 
dynamics [10], [16], [17]. Assume that we have no access 
to the quantum environment surrounding X, and that the 
dynamics in T)(Hi) is continuous in time, the state change 
at each t > being described by a TPCP map T t (-). A 
differential equation for the density operator of T may be 
derived provided that a forward composition law holds: 

Definition 2 (QDS): A quantum dynamical semigroup is a 
one-parameter family of TPCP maps {%(■), t > 0} that 
satisfies: 

(i) % = I, 

(ii) T t oT s =T t+s , Vi,s>0, 

(iii) trace(7^ (p)X) is a continuous function of t, Vp G D(Hi), 
VX e B(Hi). 

Due to the trace and positivity preserving assumptions, a QDS 
is a semigroup of contractiono It has been proved [16], [18] 
that the Hille-Yoshida generator for a QDS [19] exists and can 
be cast in the following canonical form: 

jp{t) = C( P (t)) = -i[H,p(t)} + ]T C kl (p(t)) (1) 

k,l=l 

d 2 -l 

= -i[H,p(t)} + -J2 a ^ (2FkP(t)F? - {FlF u p(t)}) , 

,2 1 

where {Fk} k=0 is a basis of 03 (Hi), the space of linear 
operators on Hi, with Fq = I. The positive definite (d 2 — 1)- 
dimensional matrix A = (aid), which physically specifies 
the relevant relaxation parameters, is also called the Gorini- 
Kossakowski-Sudarshan (GKS) matrix. Thanks to the Hermi- 
tian character of A, Eq. (Q~|i can be rewritten in a symmetrized 

1 The CP assumption is necessary to preserve positivity of arbitrary purifica- 
tions of states on Hi, including entangled states, see e.g. [2] for a discussion 
of a well-known counter-example, based on the transpose operation. 

2 A map / from a metric space 9Jt with distance d(-, •) to itself is a 
contraction if d(f(X), f(Y)) < kd(X, Y) for all X, Y in 371, < k < 1. 
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form, moving to an operator basis that diagonalizes A: 

d 2 -i 

C{ P {t)) = -i[H, p{t)\ + lkD{L k ,p{t)) (2) 

k=l 

d 2 -l . 

= -i[H,p(t)} + J2 lk(L kP {t)L\ - -{L\L k , p(t)}), 

k=l 

with {7/t} denoting the spectrum of A. The effective Hamilto- 
nian H and the Lindblad operators L k specify the net effect 
of the Markovian environment on the dynamics. In general, H 
is equal to the isolated system Hamiltonian, Hq, plus a cor- 
rection, Hl, induced by the coupling to the environment (so- 
called Lamb shift). The non-Hamiltonian terms V(L kl p(t)) 
in (0 account for non-unitary dynamics induced by L k . 

D. Phenomenological Markovian models and robustness 

In principle, the exact form of the generator of a QDS may 
be rigorously derived from the underlying Hamiltonian model 
for the joint system-environment dynamics under appropriate 
limiting conditions (the so-called "singular coupling limit" or 
the "weak coupling limit," respectively [10], [14]). In most 
physical situations, however, carrying out such a procedure is 
unfeasible, typically due to lack of complete knowledge of 
the full microscopic Hamiltonian. A Markovian generator of 
the form (0 is then assumed on a phenomenological basifl 
In practice, it is often the case that direct knowledge of the 
noise effect is available, allowing one to specify the Markovian 
generator by either giving a GKS matrix in (0 or a set of 
noise strengths -f k and Lindblad operators L k (not necessarily 
orthogonal or complete) in 0. Each of the noise operators L k 
may be thought of as corresponding to a distinct noise channel 
V(L k , pit)), by which information irreversibly leaks from the 
system into the environment. 

Example 1: Consider a two-level atom, with ground and 
excited states \ip g ), \i^ e )> respectively. Assume that there is 
an average rate of decay from the excited to the ground state 
7 > 0, that is, the survival probability of the excited state \tp e ) 
decays as e~ 7 *. The resulting dynamics is well described by 
a semigroup master equation of the form 

d 7 / \ 

— p{t) = -iu[a z , p(t)} + -[2a-p{t)a + - {a+a-, p(t)}), 

where to > determines the energy splitting between the 
ground and excited state, and er_ = \i/j g )(ip e \, a + = al_ are 
pseudo-spin lowering and raising operators, respectively. In 
fact, computing the probability P e (t) = trace( j o(0)p(t)), with 
initial state p(0) = \-ip e ){ip e \, yields P e (i) = e~^. 

In the above example, a single noise channel, 2?(cr_ , p(t)), 
is relevant. In physical situations, it often happens that known 
properties of the error process naturally restrict the relevant 

3 The Markovian generator can be inferred from experimentally available 
data via quantum process tomography, see e.g. [2]. By measuring the effect 
of the environment on known states for fixed times, one may reconstruct 
the corresponding set of CP maps and the underlying infinitesimal generator. 
Special care must be paid to the fact that this procedure may lead to non- 
CP maps in the presence of measurement or numerical errors [20]. In some 
situations, approximate models may be obtained upon formal quantization of 
a classical master equation, e.g. the so-called Pauli master equation [10]. 



Lindblad operators or the admissible GKS descriptions to a 
reduced form which incorporates the existing constraints. A 
paradigmatic QlP-motivated example is the following: 

Example 2: Consider a quantum register Q, that is, a 
quantum system composed by q two-dimensional systems 
(qubits), with associated state Hq = C^®- • -®C 2 q y d = 2 q . 
For an arbitrary Markovian error process, combined errors on 
any subset of qubits may occur, corresponding to an error 
basis {F k } which spans the full traceless sector of 23(7Yq) or, 
equivalently, the (d 2 ~ l)-dimensional Lie algebra su(d). Under 
the assumption that linear decoherence takes place, errors can 
independently affect at most one qubit at the time, reducing 
the relevant error set to operators of the form [6], [3]: 

F ki i = ® • • ■ I (fe_1) <g> <r[ k) (g> I (fc+1) <g> • • • <g> l (q) , 

where k = l,...,q, and I — x,y,x. Completing these 3q 
orthonormal generators to the above basis for the traceless 
operators in Q3(7Yq), Eq. (0 formally holds. Clearly, the 
resulting matrix A differs from zero only in a (3q x 3q)- 
dimensional block. If the noise process is additionally re- 
stricted to obey permutational symmetry (so-called collective 
decoherence), the relevant error set is further reduced to 
completely symmetric generators of the form 

i 

Ft = ® •• -® a i k) ® • •• ® l(9) > 1 = x 'y> z > 

in which case span{Ffc} ~ su(2), and A may effectively be 
taken as a 3 x 3 positive-definite matrix. 

The above examples show how, in practice, a compact 
version of (HJ typically suffices, in terms of (orthonormal) error 
generators {F k } spanning a m-dimensional error subalgebra, 
m < d 2 — 1. The corresponding Markovian generator in ([TJ 
is then completely specified by a reduced GKS matrix of 
dimension m x m. 

In the following sections, we are interested at characterizing 
dynamical properties of finite-dimensional QDSs in terms of 
their generator. As in most situations only limited or approxi- 
mate knowledge about the model is available, we are naturally 
led to consider two kinds of structured robustness [21], [22]: 

Definition 3 (Model robustness): Assume that a system T 
undergoes QDS dynamics, under a nominal generator of the 
form (Q]i or (0, with uncertain knowledge of the parameters 
A = (a,jk)™ k=1 or T = (71, . . . ,7 m ). Let A and V denote 
the uncertainty sets, that is, the sets of parameters identifying 
the admissible models in the form ((TJ and (0, respectively. A 
property Cp is said to be 

(i) A-robust if it holds for every A = (a»j ) G A; 

(ii) ^-robust if it holds for every T = (71, . . . , j m ) € V. 

The study of A- or 7-robustness is important to establish 
whether a desired feature of the model (e.g. invariance of a 
subsystem, existence of attractive states) may be ensured by 
avoiding fine-tuning on the noise parameters [6]. 

Remarks: A-robustness implies 7-robustness. However the 
converse is not true. In fact, 7-robustness corresponds to 
robustness only with respect to variation in the spectrum of A. 
While studying A-robustness, we shall always imply a reduced 
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description as explained above, with A = {A = (afc,z)™i=i} 
denoting the set of relevant reduced GKS matrices. Clearly, 
only properties that are completely independent of the partic- 
ular noise model can be A-robust if A is the whole B(Hi). 

II. Theory 
A. Quantum subsystems and their role in QIP 

In order for the physical system X to implement a QIP task, 
it is necessary that at every point in time well-defined "logical" 
degrees of freedom exist, which carry the desired quantum 
information and support a basic set of control capabilities. 
Within the standard quantum network model [2], such set must 
include the ability to: 

• Unitary control: Implement a set of control actions that 
ensure universal control. 

• Initialization: Realize a quantum operation that prepares 
the system in an intended pure state. 

• Read-out: Perform measurements of appropriate sys- 
tem's observables^. 

According to the subsystem principle [7], [4], the most 
general structure which can faithfully embody quantum in- 
formation is a subsystem of X. Intuitively, a subsystem may 
be thought of as a "portion" of the full physical system, 
whose states, in the simplest setting, obey perfectly the criteria 
above. Logical subsystems may or may not directly coincide 
with physically natural degrees of freedom. If X is noisy, 
in particular, it suffices that the action of noise be either 
negligible or correctable on subsystem where the information 
resides. Thus, protecting information need not require the 
full state of the physical system to be immune to noise, 
although this typically involves encodings which are entangled 
with respect to the natural subsystem degrees of freedom. A 
paradigmatic example is the protected qubit encoded in three 
spin-1/2 particles subject to collective decoherence [3], [7]. 

Formally, the following definition is suitable to QIP settings: 

Definition 4 (Quantum subsystem): A quantum subsystem 
S of a system X defined on Hi is a quantum system whose 
state space is a tensor factor Hs of a subspace Hsf of Hi, 

Hi =Hsf®H r = {H s ®H f )®Hr, (3) 

for some factor Hf and remainder space Hr. The set of linear 
operators on S, B(Hs), is isomorphic to the (associative) 
algebra on Hi of the form Xi — X s ® l F © Or. 

Let n = dim(Tis), / = dim(?if), r = dim(Wfl), and let 
{|0f)}?=i. {|0*)}Ln {|0f»F=i denote orthonormal bases 
for Hs, Hf, Hr, respectively. Decomposition <£3j is then 
naturally associated with the following basis for Hi: 

{\<P m )} = {|<#> ® 'L U »[=!• 

This basis induces a block structure for matrices acting on Hi: 



XsF 


x P 




Xr . 



(4) 



4 In the simplest setting, the ability to effect strong, von Neumann projective 
measurements is assumed, which together with unitary control implies the 
ability to initialize the state. 



where, in general, X$f 7^ Xg ® Xp. Let Hsf be the projec- 
tion operator onto Hs ® Hf, that is, Hsf — ( Isf | ). 

For a noisy system X, the goal of passive quantum error 
control is to identify subsystems of X where the dominant error 
events have minimum (ideally no) effect. Loosely speaking, 
each error operator belonging to the fixed error set for which 
protection is sought must have an "identity action" once ap- 
propriately restricted to the intended subsystem. Historically, 
the first kind of subsystems considered to this purpose have 
been noiseless subspaces of the system's Hilbert space, often 
called DFSs in the relevant literature [5], [6]: 

Hi = Hdfs © 'Hr, 

which corresponds to a special instance of decomposition (0) 
with one-dimensional "syndrome" co-subsystem T, Hf — C 
The possibility for genuine noiseless subsystem-encodings to 
exist and be useful was recognized in [3], in which case we 
specialize the notation of to 

Hi = {H ns ®H f )®Hr, (5) 

by explicitly identifying the noiseless factor with 7ijv,gEl 

DFS and NS theory has received extensive attention to date. 
A relatively straightforward characterization is possible for 
error sets which are effectively f-closed, in which case elegant 
results from the representation theory of C*-algebras appljU. 
The operator-algebraic approach is suitable for investigating 
NSs within both a Hamiltonian formulation of open-system 
dynamics and a large class of TPCP maps, see e.g. [3], 
[23]. However, explicit characterizations for arbitrary quantum 
operations and Markovian dynamics are more delicate and, to 
some extent, less consolidated. While a number of definitions 
and results are provided in [8], [11], [24], the increasingly 
prominent role that quantum subsystems play within quantum 
error correction theory [25], along with continuous experimen- 
tal advances in implementing DFSs [26], [27], [28] and NSs 
[29], heighten the need for a fully consistent system- theoretic 
approach. It is our goal in the remaining of this Section to 
provide such a framework for the case of Markovian dynamics, 
by paying special attention to the key role played by model 
robustness notions as stated in Definition 3. 

B. Invariant subsystems 

Definition 5 (State initialization): The system X with state 
p G 53 (Hi) is initialized in Hs with state ps G T)(Hs) if the 
blocks of p satisfy: 

(i) PSF = Ps® Pf for some p F G ®(Hf); 

(ii) p P = 0,p R = 0. 

5 In principle, multiple NSs may exist for a given dynamical system. While 
we do not explicitly address such a scenario, generalization is possible along 
the lines presented here. 

S A C*-algebra is a complex normed algebra A with a conjugate linear 
involution (* or f, an adjoint operation), which is complete, satisfies ||AB|| < 
||A||||B||, and \\A^A\\ = \\A\\ 2 , for all A, B 6 A. Any norm-closed 
subspace of bounded operators on H is a C*-algebra if it closed under the 
usual adjoint operation. Up to unitary equivalence, every finite-dimensional 
operator *-algebra is isomorphic to a unique direct sum of ampliated full 
matrix algebras. Such a decomposition directly reveals the supported NSs, 
whenever A represents an error algebra for the noisy system X [3]. 
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Condition (ii) in the above Definition guarantees that ps = 
trace p (Us fP^sf) * s a va lid state of S, while condition (i) 
ensures that measurements or dynamics affecting the factor 
Hf have no effect on the state in Hs- We shall denote by 
3s (Hi ) the set of states initialized in this way. The larger set 
of states obeying condition (ii) alone will correspondingly be 
denoted by 3sf(Hi). 

Definition 6 (Invariance): Let X evolve under TPCP maps. 
S is an invariant subsystem if the evolution of p E 3s (Hi) 
obeys: 



Pit) 



T t s (ps)®T t F ( PF ) 















t > 0, 



(6) 



Vp s € S>(Ws), Pf G T)(H F ), and with % s (-) and Tf(-), 
t > 0, being TPCP maps on Hs and Hj?, respectively. 

Thus, a subsystem is invariant if time evolution preserves 
the initialization of the state, that is, the dynamics is confined 
within 3 s (Hi). For Markovian evolution of I, Definition [2] 
requires both {T t } and {T t F } to be QDSs on their respective 
domain. We begin with the following elementary Lemma: 

Lemma 1: Let a linear operator L : Hi ® H2 — > H3 be 
different from the zero operator. Then there exist factorized 
pure states in Hi <£> H2 © ker(L). 

Proof. Assume that L\tp) = for all factorized \ip) E H\®H2- 
Since such \i())'s generate the whole H\®Hii then by linearity 
it must be L = and we conclude by contradiction. ■ 

Theorem 2 (Markovian invariance): Hs supports an in- 
variant subsystem under Markovian evolution on Hi iff for 
every initial state p E 3s (Hi), with ps E %)(Hs), Pf G 
D(Hf), the following conditions hold: 



d , . 



£-SF(pSF(t)) 











vt > 0, 



trace F [C SF {psF(t))] = £ S (ps(t)), Vt > 0, 



(7) 
(8) 



where Csf and £5 are QDS generators on Hs®Hf and Hs, 
respectively. 

Proof. Since Definition [6] is obeyed, computing the infinitesi- 
mal generator of © (at t = 0) yields 



dt 



Pit) 



t=o 



(£ s ®1 F + ls ® £f)(ps ® Pf) 















(9) 

Then the time-invariant generator must have the form ©. Take 
the partial trace over Hf, and observe that trace(pF) = 1, 
tmce(£ F (pF)) = 0. Then © holds. 

To prove the opposite implication, assume that © and © 
hold, and p E 3s(Hi). Since p evolves under a QDS generator 
that can be written in the form ©, with Hamiltonian H 
and noise operators L k partitioned as in (g), computing the 
generator at a generic time t by blocks yields: 



d_ 

dt 



P = 



£sf(p) 


Cp(p) 


Cq(p) 


£r(p) 



where 

£sf(p) 

£q(p) 
Cp(p) 



-i[H S F,PsF] + ^ ^2 {^LsfmPsfL 

k 

- { L SF,k L SF,k + L^ Q k L Qtk , psf}) , 

-iH P psF + \\^2 {^L S F,kPSFL ] Qk 
k 

- PsF(L SFk L P ^ k + l) Q k L R , k )} , 
ipsFHp + 2 {^ L SF,kPSFL 



t 

SF.k 



-t 

J Q,k 



,L 



+ L Q,k L R,k ) , 



- PSF(L SFk 
£r(p) = \^2 2L Q,kPSF^ Q ^ 



In order to satisfy ©, it must be \ 2~2 k ^Lq^PsfLq k = 
0, for every psf = Ps ® Pf- Consider for example pure 
product states psf — (4>\ <£> \4>)(4>\- Then, by observing that 
Lq^psfLq k is positive for every k and by using LemmaQ] it 
must be Lq^ = for every k. Next, to ensure that pp(t) = 
for every t, the remaining contribution to Cp(p) must vanish, 
that is, by using Lemma Q] again, it must be: 



1 X X 

L SF,k L P,k = 0. 



(10) 



This leaves a 5F-block of the form: 



t 

SF.k 



-i[H S f,psf] + (2LsF,kPSpL 

k 

~ { L SF.k L SF,k, PSfY) 1 

which indeed satisfies ©. To see this, notice that we may 
always write L S F,k = J2 t M kyi (g>N kyi , with M k ^ (N k ,i) being 
operators on Hs (Hf), respectively (this follows e.g. from the 
operator Schmidt-decomposition [30]). Thus, we obtain 

^LsF.kPSFL SF k — $yl) SF k L,SF,ki PSf \ = 

= J2 (^MmpsMIj ® N kilPF Nl 



1,3 



(11) 



-(Ml tj M k ,ips ® Nl d N h ,ipF 
+psMl d M k ,i ® ppNtjNuj) ■ 

By tracing over Hf, and using the cyclic property of the (full) 
trace, we obtain: 

tracer ^2L S F,kPsFL SF k - ^ SF k LsF,k, Psf\ = 

{ 2M k,iPsMl tj - (Ml ^ps + psM^M^)) , 

where — trace(ppNl jN k ,i). Since we require © to be 
independent of pp, LsF,k must take one of the following two 
forms: 

LSFM = ^2 Mk >3 ® Iir = Ls * ® If ' 
3 

LsF,k = ^2 Is ® ^ fe J = Is ® iF < fc - 
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A similar reasoning shows that H is constrained to 

H = H s <8> If + Is ® H 



F • 



Thus, the generator has the form declared in {9). ■ 

As a byproduct, Theorem[2]s proof gives explicit necessary 
and sufficient conditions for the blocks of H and L k to ensure 
invariance. We collect them in the following: 

Corollary 1 (Markovian invariance): Assume that Hi = 
(Hs ® Hf) © Hr, and let H, {L k } be the Hamiltonian and 
the error generators of a Markovian QDS as in (fJJ. Then Hs 
supports an invariant subsystem iff V k: 



L k = 
iH P - 



Ls,k ® L>F,k 


Lp t k 





LR,k 



F,k) L P,k 



2 X^kfc 

k 

H S f = H s O If + Is <S> H F 



(12) 



where for each k either Ls.k = Is or Lp.k = If (or both). 

If we require parametric model robustness, as specified in 
Definition [3] additional constraints emerge from imposing that 
(|7]i and <[8J hold irrespective of parameter uncertainties. The 
results may be summarized as follows: 

Theorem 3 (Robust Markovian invariance): Assume Hi = 
(H s ®H F )<3 Hr. (i) Let {F k } be the error generators in (T). 
Then Hs supports an A-robust invariant subsystem iff Vj, k, 



Fk. 



Fs,k ® Fp.k 


Fp t k 





F R , k 



F 



p, fe (^, J -<8i ? F,i)=0, 
Hsf = H s <8> If + Is € 



(13) 

F P = 0, (14) 



where either Fs,k — Is f° r every k, or = Ip for every fc, 
or both, (ii) If {L k } are the noise operators in iff), then Hns 
supports a j-robust invariant subsystem iff V fc, 



(15) 
(16) 



L k = 
rt 

#SF = ffs 





Lp t k 





Lr^ 



(L S ,k 



Lfm, 
8 If - 



= 0, 

I s ®Ff, i?p = 0, 



and for each fc, either Lg^ = Eg or Lp,k — Ip (or both). 

Proof. Consider case (i). Given Theorem [2] conditions (0- 
dHJ must hold irrespective of A = (cijk) in fl}. The lower- 
diagonal block is now J2jk a jkFQ.jPSFFQ k . Considering 
only the diagonal terms j = k, we are again led to require 
Fqm — for every k. Thus, condition ( TTOb must be replaced 
by iHp — J2jk a jkFg F k Fpj = 0, which is true for every 
A = (djk) iff Hp and F P k (Fsj®Fpj) vanish independently, 
as stated in (TOl l. (TBI . 

To complete the proof, as before we write F 8 F,k = 
Y,k,i M k,i ® JV"fe,i, with M M (iV fc) j) operators on H W s 
respectively. Then we have: 



"2F S FjPSFFt; Fk - [Fl Fk F S Fj,p S F^ - 

= E ( 2 %^ M l, m ® N 3,WFNl m 
l,m 

- (Krn^PNS^Nl ^jpF 

+ PNsMl m M jtl ® ppN^.m^l)) • 
By tracing over 7i F and using cyclicity yields 

fd^M jtl p N8 Ml )m - (Ml m M 3 , lPN s + PNsMl m M 3 ^ , 



l, in 



where b,^ — tiace(pFNl Njj). Since we wish (O to be 
independent of pp, it follows that for every k, F$F,k takes 
one of two possible forms: 



FsF.k = 2J ^NS ® N m ,fc = liVS <S ^F,fe, 



SFfc 



E 



F. 



NS,k 



which establishes the conditions for A-robustness. 

For 7-robustness, it suffices to specialize the above proof to 
diagonal A, that is, to consider only j — k. This let us identify 
the Lfe's with the F k 's, and the result follows. ■ 

C. Noiseless subsystems 

As remarked after Definition |5J given p e D(Hi), the 
reduced projected state: 

(17) 



p s = trace F (IIg F pn SF ), 

need not be a valid reduced state of S if pp 7^ 0, since 
its trace might be less than one. Still, to the purposes of 
defining noiseless behavior, there is no reason for requiring 
that the evolution has to be confined to 3s(Hi), as long as the 
information encoded in the intended subsystem is preserved, 
i.e. it undergoes unitary evolution. This motivates a weaker 
definition of initialization: 

Definition 7 (Reduced state initialization): The system 2 
with state p is initialized in Hsf with reduced state ps S 
D(Hs) if the blocks of p satisfy: 
(i') trace F (p SF ) = p s ; 
(ii) p P = 0,p R = 0. 

Remark: The above definition is equivalent to state initial- 
ization as in given in Definition [5] if we restrict to pure states 
in Hs, but it allows for entangled states otherwise. 

Definition 8 (Noiselessness): Let I evolve under TPCP 
maps. A subsystem S is a NS for the evolution if for every 
initial state p(0) of X initialized in S with reduced state pg(0): 



PNs(t) = U(t)p s (0)U(t)\ t > 0, 



(18) 



where U(t) is a unitary operator on Hs, independent of the 
initial state on Hp If Hf — C, the NS S reduces to a DFS. 

Following [11], we shall say that perfect NS initialization 
occurs when (i') and (ii) are obeyed, and call subsystem 
S imperfectly initialized whenever (i') or (ii) is violated. 
Physically, Definition 8 requires the state component p^s 



7 



carried by Hs to evolve unitarily, independently of the rest. 
The following proposition establishes how, in fact, a perfecly 
initialized NS is a special case of an invariant subsystem: 

Proposition 1: Let Hi = (Hns © Hf) © Hr. Then Hns 
supports a NS for some given TPCP dynamics iff for all 
initial condition p e 3ns(7~Li), with pns £ T)(Hns), Pf G 
D(Hf), the evolved state of X obeys 



Pit) 



U(t)p NS UHt)®T t F (p F ) 















t>0, (19) 



where U (t) is a unitary operator on Hns and {^t F } are TPCP 
maps on Hf alone. 

Proof. Assume Hns to support an NS and to be initialized 
with reduced state pns, where it could be pnsf{0) 
Pns(0) © Pf (0). Let pnsf(0) = X)fc ^fe © i*k> with 5 fe and 
Fk operators on Hs and Hf, respectively. Thus, pns(0) = 
^2 k tiace(Fk)Sk- Notice that, by linearity: 



trace F (II SF p(t)l4 F ) = trace F U(t)S k uHt) © T F (F k ) 

k 

\U(t)S k U*(t)tiaai(T t F (F k j) = U(t)p NS (0)U*(t). 



E 1 



Thus, the condition is sufficient. 

To prove the other implication, notice that if the evolution 
of Pns is unitary, it preserves the trace. By the properties of 
partial trace and by (fTTT i. it then follows that trace (pNs(t)) — 
trace(pNSF(t))- Therefore, pr = must vanish at all times in 
order to ensure TP-evolution in the S^-block and, similarly, 
pp = in order to guarantee positivity of the whole state Q 
Then for every t > the evolution must take the form: 



Pit) 



T t NSF ( P NSF) 















where T t NSF is a TPCP map on Hns © Hf- Now use 
the Kraus representation theorem and the operator-Schmidt 
decomposition, by employing a basis for *B(Hs), say {Mj}, 
such that, Vpns G D(H N s), Pf G D(H f ), 



T t NSF { PNS ®Pf)=Y\ M W nsMI © NkippNl , 



kirn 



Thus, 



tTacc F [IlNSFp(t)Il NSF ] = T t s (p N s) = ^aimMipNsM^, 

In 



where a; m = trace (j2 k N% m N k ,iPFj is a positive matrix. 
By exploiting the fact that {Mj} is a basis, and decomposing 
Sfc Nj. m Nk,i in Hermitian and skew-Hermitian parts, one 
can see that a necessary and sufficient condition in order for 
T t s to be independent of pp is that J2k ^1 m-^k,l — a mi^F 
for every j,k. By imposing that trace F [ns F p(<)ILt F ] = 
U(t)ps(Q)W (t), (ctjk) must have rank one, thus otjk = ctjCtk 
for some {ctj}. If we additionally choose the operator basis 
{Mj} so that Mi = U(t), then an is the only non-zero 
entry, in particular, J2k ^1 i-Nk,i = for every I ^ 1. This 

7 This follows from the fact that if p = (pij) > 0, then \ptj\ < ■Jpupjj- 



implies N k i = for every I ^ 1, thus yielding to the desired 
conclusion: 

% SF { PS ® pf) = U{t) Ps U{tf ® N kPFNl 

k m 

On one hand, as a consequence of the above Proposition, 
if reduced state initialization is assumed (as in Definition |7), 
the factor Hns supports an NS only if it is invariant. On the 
other hand, under the stronger condition of initialization of 
Definition [5] if Hns is invariant and unitarily evolving, then 
it supports a NS. Accordingly, most of the results concerning 
NSs may be derived as a specialization of conditions for 
invariance. Remarkably, this also implies that in the particular 
case of a NS, the invariance property is robust with respect 
to the initialization in the A^F-block, that is, condition 
(i) may be effectively relaxed to (i')- This is not true for 
general invariant subsystems. Explicit characterizations of the 
Markovian noiseless property may then be established as 
summarized in the rest of this Section. 

Corollary 2 (Markovian NS): Let Hi = (Hns ® rip) © 
Hr. Then Hns supports a NS under Markovian evolution 
on Hi iff for every initial state p £ 3ns{Hi), with pns G 
£>(WiVs), Pf G D{H F ), and Vt > 0: 



d , „ 
dt P ^ 



C-NSF{PNSF(f)) 







tracer [C N SF{pNSF{i))] = -i 











Hns, PNs(t)), 



(20) 
(21) 

>Hf 



where Cnsf and Cns are QDS generators on Hns 
and Hns, respectively. 

Proof. Given Proposition Q] and Theorem |2j we need to ensure 
that the evolution in H ns is unitary. That is, the NSF -block 
must be driven by an generator of the form —i[Hns, Pns] ® 
Pf + Pns <8 Cp{pp), which replaces (O and ensures unitary 
evolution on the NS -factor, while allowing for general non- 
unitary Markovian dynamics on Hf- The proof of Theorem [2] 
applies, with the noise operators constrained to have the form 



LNSF.k = > Is®N kJ =I S 



3 



^F,k- 



Accordingly, the necessary and sufficient conditions on the 
matrix blocks of H and L k for NS-behavior are modified to: 

Corollary 3: Assume Hi = (Hns ® Hf) © 7~Lr, and let 
H, {L k } be the Hamiltonian and the error generators of a 
Markovian QDS as in d2j. Then Hns supports a NS iff Vfc: 



Li 



iH, 



Ins © L Ftk 


Lp, k 





LR,k 



^f k)Lp,k — 0, 



(22) 



Hnsf = Hns © I_f + ^ns © Hp. 
While derivations differ, Corollary |3]provides the same NS- 
characterization of Theorem 5 in [11]. Beside more directly 
tying to the CP context, our approach shows how the NS 
notion may emerge as a specialization of the conditions for 
invariance. Following the same lines as in Section II-B, we 
next proceed to a general result forA- and ^-robust NSs, which 
completes the partial conditions proposed in [8]: 



s 



Corollary 4 (Robust Markovian NS): Assume that Hi = 
(Hns <8> H F ) © Hp. (i) Let {Fk} be the error generators in 
(Q3. Then Hns supports an v4-robust NS iff Vj, fc: 





Fp^k 








F 



P ^NS®F F ,j) = 0, 
H NS f = H NS ® If + Ijvs 



(23) 

ff P = 0. (24) 



(ii) If {Lfc} are the error generators in (O, then Hns supports 
a 7-robust NS iff Vfc: 



L k = 



F,fc 



I 



Vfc, 



(25) 



o. 



Hi? . Hf 



o. 



(26) 
(27) 





>p,fe(IjV,S ® iF,fe) 

Hnsf = Hns <8> If + I/vs ' 
Proof. Given Theorem [3] it suffices to ensure that evolution in 
Hns be unitary (as in Corollary|2]i, for every A. This is true iff 
Hp = and F Pk (I N s®F F j) = independently. From ( fTTI ). 
FsF,k = Is <8> -Ff,/c must hold for every fc. The specialization 
to a 7-robust NS follows from similar observations. ■ 

Clearly, an A-robust NS may exist only if the {Fk} do not 
generate the whole 2}(7ij), that is, we are restricting to a set 
of possible noise generators as remarked in Section II-DI For 
applications, it may be useful to further specialize the result 
to the case of a 7-robust DFS, for which H F is trivial: 

Corollary 5 (^-robust DFS): Assume Hi = Hdfs ®Hr. 
Let {Lk} be the error generators in ©. Then Hdfs is a 
7-robust DFS iff Vfc: 



0, L k 



ClJ-DFS 


Lp.k 





LR t k 



(28) 



with Lp.k = if Cfe 7^ 0. 

Proof. In Corollary |4] above, set H F — C. ■ 

An alternative formulation of Corollary [5] also holds: 
Proposition 2 (Alternative ^-robust DFS condition): 
Hdfs = ^V w {\ ( t ) f FS )} is a 7-robust Markovian DFS 
subspace of Hi iff Vj, fc the following conditions hold: 



0. 



bfFS) 



Cfe |0 



DFS\ 
j I 



\c k ?\4>r s " 



Proof. Assume that Vfc, L k \4>f FS ) = c k \4>f FS ). Then it must 
be 



Lk = 



Ck^DFS 


Lp.k 





LR t k 



Since 



CkC* k lDFS 


c *k L P,k 


CkL pk 


L pk Lp tk + L Rk L R . k 



then L\L k \4>J b ) = \c k \ \4>J h ) is true iff the conditions of 
the proof of Corollary [5] are obeyed. ■ 

Remark: According to the above Corollary, 7-robust DFS- 
states are joint (right) eigenvectors of both each Lindblad 
operator Lk and each "jump" operator L* k Lk- Such charac- 
terizations of A- and 7-robust DFSs link our analysis to the 



definition presented in [31]. In fact, the definition of DFS 
property invoked there imposes more constraints than our 
Definition [7] it requires the Hamiltonian to preserve the DFS 
independently from the dissipative component of the generator. 
This may be regarded as a yet different kind of robustness, 
weaker than both 7- and ^-robustness investigated here. 

D. Imperfect initialization 

Thus far, we have addressed model robustness of the 
invariance and the noiselessness properties. As the relevant 
subsystem dynamics also depends on the initial state, it is 
natural to ask how critical initialization is to the purposes of 
ensuring a desired behavior. This motivates the introduction 
of a different robustness notion: 

Definition 9: Assume that Hi = {Hs®H f )®Hr, and let 
I undergo QDS dynamics with a generator of the form (Q~|i or 
(O. Let a given property ^5 hold for the dynamical model 
initialized in Hs, according to Definition [5] If *Ps holds for 
ps = trace f (Us F pHsf) for every p e D(Hi), then *Ps is 
said to be p-robust. 

This approach leads to the same conditions for imperfect- 
initialization Markovian NSs (initialization-free NS) obtained 
in [ll].ByDefinition|9l considering Hi = {H N s®H F )®H Rl 
a subsystem supported on Hns is a p-robust NS if for every 
t > 0, Vp(0) with reduced state p/vs(0) € D(Hns)' 

p NS (t) - trace F (n A r S Fp(i)n] VSF ) = U(t)p NS (0)tf (t), 

where U(t) is unitary on Hns- This means that the dynamics 
of the A^F-block cannot be influenced by pp, pp.. Notice that 
Proposition [TJ has already clarified how imperfect initialization 
in the NSF block does not affect the unitary character of 
the evolution of the reduced state of the NS. Computing the 
generator C(p) by blocks, by inspection one sees that for all 
fc it must be Lpk = 0, Lq ^ = 0, hence Hp = 0. By the 
proof of Theorem HI it also follows that LNSF,k =10 Mk. 
Thus, the main difference with respect to the perfect NS- 
initialization case is the constraint Lp.k = 0, which decouples 
the evolution of the A^S'f-block from the rest. Notice that this 
also automatically ensures 7-robustness in our framework. 

E. Attractive subsystems 

The analysis developed so far indicates how initialization 
requirements may be relaxed by requiring p-robustness. How- 
ever, this implies in general tighter conditions on the noise 
operators, which may be demanding to ensure and leave less 
room for Hamiltonian compensation of the noise action (see 
Section Ull-Bb . In order to both address situations where such 
extra constraints are not met, as well as a question which is 
interesting on its own, we explore conditions for a NS to be 
not only invariant, but also attractive: 

Definition 10 (Attractive Subsystem): Assume that Hi = 
(Hs ®H F ) ®Hr. Then Hs supports an attractive subsystem 
with respect to a family {T t } t > of TPCP maps if Vp e D{Hi) 
the following condition is asymptotically obeyed: 



lira [%{p)- 



Ps{t)®p F {t) 











= 0, 



(29) 
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where p s (t) = trace F [n SF T t ( j o)n^ F ], p F (t) = 
traces [n SF T t (p)4 F ]. 

An attractive subsystem may be thought of as a subsystem 
that "self-initializes" in the long-time limit, by somehow 
reabsorbing initialization errors. Although such a desirable 
behavior only emerges asymptotically, for QDSs one can see 
that convergence is exponential, as long as some eigenvalues 
of C have strictly negative real part. 

We begin with a negative result which, in particular, shows 
how the initialization-free and attractive characterizations are 
mutually exclusive. 

Proposition 3: Assume Hi — (Hns'^'Hf)(BHr, Hr 7^ 0, 
and let H, {L^} be the Hamiltonian and the error generators 
as in d2), respectively. Let Hns support a NS. If Lp,k = 
Lq k = for every k, then Hns is n °t attractive. 
Proof. Consider a block-diagonal state of the form: 



PB 



PSF 








PB, 



It is straightforward to see that the generator has the form 

d 



dt 



PB = 



£sf(psf) 











which preserves the trace of pr. Thus, if pp ^ 0, pp does 
not satisfy Eq. d29l >. ■ 

Remark: The conditions of the above Proposition are 
obeyed, in particular, for NSs in the presence of purely Hermi- 
tian noise operators, that is, Lk — iX, Vfe. As a consequence, 
attractivity is never possible for this kind of unital Markovian 
noise, as defined by the requirement of preserving the fully 
mixed state. Still, even if the condition Lp^ = Lg k = 
condition holds, attractive subsystems may exist in the pure- 
factor case, where Hr = 0. Sufficient conditions are provided 
by the following: 

Proposition 4: Assume Hi = Hs®Hp {Hr, = 0), and let 
Hs be invariant under a QDS of the form 



L = C, 



If Cf(-) has a unique attractive state pp, then Hs is attractive. 
Proof. Let p be a generic state on Hi = Hs ®Hf- p may 
always be expressed (recall the proof of Theorem |2]i in the 
form p = ^j^Pi <8> Qi- Without loss of generality, we may 
take the Qi to be Hermitian. If this is not the case, decompose 
Qi = Qf +iQf mto Hermitian and skew-Hermitian parts, so 
that Pi <g> Qi = Pi <g> Qf + (iPi) ® Qf. Each of the Q"' A 
may be further decomposed in a positive and a negative part, 
which one may normalize to unit trace. To do so, consider 
the spectral representation of each Qi, separate the positive 
and negative eigenvalues, and partition the matrix in a sum 
of two Qi = Qf + Q~. Normalize Qf , Q~ to trace 1,-1, 
respectively, and reabsorb the normalization coefficients and 
the minus sign, in Pi. Thus, we can write p = ^ i P, (g) p^.i, 
and pns = Y^i^i- By a PPly m 8 me above generator to such 
a state and using the linearity of the evolution, 



lim p t = V lim (T^(Pi) ® Tp{p FA 

i 

= ( V lim T*(P Z )) ®p F = lim 7%(p NS ) ® Pf, 



thus the desired conclusion follows. ■ 
In the mathematical-physics literature, QDSs with a unique 
attractive stationary state are called relaxing, and have been 
mostly studied in the '70 in the context of rigorous approaches 
to quantum thermodynamics. Useful linear-algebraic condi- 
tions for determining whether a generator Cf(-) is relaxing 
are presented in [32], [33]. The uniqueness of the stationary 
state turns out to be necessary when considering NSs: 

Proposition 5: Assume Hi = Hs ®H F , {Hr, = 0), and 
let Hs support a NS under a QDS of the form 



C = C s 



If Cp(-) admits at least two invariant states, then Hs is not 
attractive. 

Proof. It suffices to construct a state of the form: 



P : 



(i) 
PPs 



' P ( P + (1 



(2) 

Pf 



where pg,Ps mQ orthogonal pure states on Hs, and 
p F \ pf are the two invariant states for C F , and < p < 1. 
Again, by using the linearity of the evolution, 



p{t) = [pT s {pf) 



Tp{pf) + {l-p)T s {pf) 



= pUs(t)p i s 1) ul(t) <g) pf + (1 - p)U s {t)pful{t) <g) pf, 

so it follows that the state does not factorize for any t > 0. ■ 

Note that proper initialization plays a more critical role 
in the DFS- than in the NS-context, as a consequence of 
Proposition Q] If H F ^ C and the initial state is not factorized 
on the TV^F-block, the reduced state on Hns still evolves 
unitarily, provided that the generator satisfies the conditions 
given in Corollary [3] Practically, this means that there is no 
actual need to require a (factorized) subsystem-initialized state, 
as long as a bounded error on the NS-component can be 
tolerated. For an imperfectly-initialized DFS, unitary evolution 
on the intended block can only occur if Lp,h = 0, making 
attractivity a compelling option if the latter does not hold. 
Accordingly, our main emphasis is on attractivity in the DFS- 
case, which may be guaranteed by invoking a specialization 
of the Krasowskii-LaSalle invariance principle (see e.g. [34]). 

Theorem 4 (Attractive Subspace): Let Hi = Hs © Hr 
{Hp = C), and let Hs support an invariant subspace under C. 
Assume that there exists a continuously differentiable function 
V{p) > on D(Hi), such that V(p) < on imperfectly 
initialized states in D(Hi) \ 3s {'Hi)- Let 



W = {p G $)(Hi)\ V(p) = Q}, 
Z = {pe 2>(W/)|trace[II fl £(p)] 



0}, 



where XIr is the orthogonal projector on Hr. If W fl Z C 
3s{Hi), then Hs is attractive. 

Proof. Consider V\{p) — trace(II^p) + trace(HRp)V(p). It is 
zero iff pp = 0, i.e. for perfectly initialized states. Computing 
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C(p), we get for the R block: 

£(p)r = ~ i[H R , p R ] + ippHp - iHppp 

~ \ E ( 2L R-,kPR L R,k ~ i L R,k L R,^ PR} 



- L Q , k , PsF^ Q k - 2{L P k Lp. k ,p R } 
" 2L R,kP P LQ tk + 2L Qtk p P L R k 

Pp( L SF,k L P* ~ L QM L R,k) 

-{L Pk L S F,k + L Rk LQ,k)pp) ■ 



Therefore, 



trace[n fl £( j o)] = --traee({ ^ L P k L P . k , 

k 

= -tracef ^ L Pk L Ptk p R ) , 



(30) 



is always negative or zero. Hence 

Vy{p) = trace(n fl £(p))(l + V{p)) + trace (U R p)V(p) < 0, 

for every D(Hi), and it is zero only in W n Z U 3 s {Hi). If 
WflZ C 3s(Hi), by applying Krasowskii-LaSalle invariance 
theorem, we conclude. ■ 

The following result immediately follows: 

Corollary 6: Assume that Hi — Hs © H R (Hf — C), and 
let Hs support an invariant subspace under C. Assume that 



E 



Lp k L P , k > 0, 



(31) 



where > means strictly positive. Then Hs is attractive. 
Proof. It suffices to note that (l3~TT l guarantees that (f30b in the 
proof of the Theorem above is zero iff p R = 0. The conclusion 
follows by taking a V{p) constant and positive on D(Hi). ■ 

Remark: From considerations on the rank of the l.h.s. of (l3TT l 
and the n x r dimension of Lp. k , the condition of Corollary 
[6] may be obeyed only if n > r, i.e. dim(Hs) > dim(Wfl). 
An application of this result will be given in Section IIII-BI 

Proposition [4] and Theorem |4] (or Corollary [6j, may be 
combined in order to obtain sufficient conditions for attractivity 
in the general NS case. 

Proposition 6: Let Hi = {Hs®Hf)®H r , and let Hs be 
an invariant subsystem under C, with 

C F (-) =trace s (n SF £(-)n SJ? ). 

Assume that there exist a continuously differentiable func- 
tional V(p) > on D(Hi), such that < on imperfectly 
initialized states in D(Hi) \ 3 S f{Hi). Let W, Z be defined 
as in Theorem [4] If Cf{-) is relaxing and WP\Z C 3sf(Hi), 
then 7Yg is attractive. 

Proof. From Corollary Q] Cf(-) is a Markovian generator on 
7Yf, thus it makes sense to require that it is relaxing. Let p R 
be its unique attractive state. Observe that from Theorem @] 
the state will asymptotically have support only on Hs <S> Hf- 

Let p S F(t) = H SF p(t)TllF- By defining r = t/2, s = t/2, 



and by invoking the Markovian property, along with the above 
observation, invariance, and Proposition |4] we may write: 

lim p SF {t) = lim n SF T T (p{s))Ill F 

t— >00 T.S— *00 ' " 

= lim T S T <g) ( lim Psf(s)) 
= lim Tg ( lim /Otvs(s)) ® Pf- 

T — ^OO S — >CX> 

The last equality comes from the fact that lim^oo psf(s) 
is certainly bounded, and can be always written in the form 
lim^oo J2k p s,k(s) ® PF,k by choosing a basis of *&{Hf) 
of density operators {pF.k} and by following ideas similar to 
those in the proof of Proposition [4] ■ 

III. Control Applications 

A. Quantum trajectories and Markovian output feedback 

Building on pioneering work by Belavkin [35], it has been 
long acknowledged for a diverse class of controlled quantum 
system that intercepting and feeding back the information 
leaking out of the system allow to better accomplish a number 
of desired control tasks (see [36], [37], [12], [38], [39], [40] 
for representative contributions). This requires the ability to 
both effectively monitor the environment and control the target 
evolution through time-dependent Hamiltonian perturbations 
which depend upon the measurement record. We begin by re- 
calling some well-established continuous-measurement models 
for the conditioned dynamics, as originally developed in the 
quantum-optics setting by Wiseman and Milburn [36], [37]. 

The basic setting is a measurement scheme which mimicks 
optical homo-dyne detection for field-quadrature measure- 
ments, whereby the target system (e.g. an atomic cloud trapped 
in an optical cavity) is indirectly monitored via measurements 
of the outgoing laser field quadrature [36], [41]. Let the 
measurement record be denoted by Y t (e.g. a photo-current in 
the above setting), and let P) a (classical) probability 

space with an associated {Wt,t € K + } standard M-valued 
Wiener process. The homo-dyne detection measurement record 
may then be written as the output of a stochastic dynamical 
system of the form: 



dY t =ritx(Mp t + p t M^)dt + y/^dW t 



(32) 



where p t = p(t) is the system state at time t, M is the mea- 
surement operator determining the system-probe interaction, 
and < r) < 1 quantifies the efficiency of the measurement. 

The real-time knowledge of the photo-current provides 
additional information on the dynamics, leading to a stochastic 
master equation (SME) for the conditional evolution: 

d Pt = [T{H, Pt ) + V(M, Pt ))dt + Q(M, p t )dW t (33) 

= ( - i[H, Pt ] + V (Mp t M^ - i{AftM, p t }))dt 

Mp t + p t M ] - tx(Mp t + ptM ] )p t dW t . 

Here, T is the Hamiltonian generator, whereas T>(M, pt) and 
Q(Al,p t ) are the Lindblad noise channel and the "diffusion" 
contribution due to the weak measurement of M. Given an 
initial condition p , the solution p t exists, is confined to 
D(Hi), and is adapted to the filtration induced by {Wt,t E 
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R+}(see e.g. [42], [43]). As the SME (O is an ltd stochastic 
differential equation, to obtain the average evolution generator 
it suffices to drop the martingale part Q{M, pt)dWt- Thus, the 
"unconditional" evolution obeys a deterministic QDS genera- 
tor of the form Notice that the diffusion term plays the 
role of the innovation part of a nonlinear Kalman-Bucy filter, 
and that the conditional state follows continuous trajectories, 
whereby the name of quantum trajectories approach in the 
quantum-optics literature [44]. 

In what follows, we assume perfect detection, that is, r\ = 1, 
unless otherwise specified (see IIII-El and |TVT ). In [37], it has 
been argued that the photo-current can be instantaneously 
fed back to further modify the dynamics, still maintaining 
the Markovian character of the evolution. This motivates 
considering a Hamiltonian feedback superoperator of the form 

j/ t =jY t mP t ), F = F\ (34) 

which is, however, ill-defined given the stochastic nature of 
Y t . In order to obtain a feedback Markovian evolution, (l34l 
has been interpreted as an "implicit" Stratonovich stochastic 
differential equation [37]. Its Ito equivalent form is: 

dp{ = F{F, Pt )dY t + ~F 2 (F, Pt )dt. (35) 

Thus, one can consider the infinitesimal evolution resulting 
from the feedback followed by the measurement action p t + 

dp t =T? ' dt °T M dt (p t ), where: 

T r M {pt) = p t + T{F, p t )dY t + ^T 2 (F, Pt )dt, 

T M dt ( Pt ) =p t + (T(H,p t )+V(M,p t ))dt + G(M,p t )dW t . 
Substituting the definitions and using Ito's rule, it yields: 

dp t = (f(H, Pt ) + V(M, p t ) + F(F, Mp t + ft Aft) 

+ - J 7 (F, Pt ))dt + (G(M, pt) + F(F, pt))dW t . 

Dropping again the martingale part and rearranging the re- 
maining terms leads to the Wiseman-Milburn Markovian Feed- 
back Master equation (FME) [36], [37]: 

j t Pt=F(H+^(FM + M^F),pt)+V(M-iF,pt). (37) 

In the following sections, we will tackle state-stabilization and 
NS-synthesis problems for controlled Markovian dynamics 
described by FMEs. 

B. Control assumptions 

The feedback state-stabilization problem for Markovian 
dynamics has been extensively studied for the single-qubit 
case [45], [46]. In particular, conditions for achieving a pure 
steady state have been identified in [47]. In the existing 
literature, however, the standard approach to design a Marko- 
vian feedback strategy is to specify both the measurement 
and feedback operators M, F, and to treat the measurement 
strength and the feedback gain as the relevant control parame- 
ters accordingly. Here we will pretend to have more freedom, 
considering, for a fixed measurement operator M, both F and 
H as tunable control Hamiltonians. 



Definition 11 (CHC): A controlled FME of the form d37l ) 
supports complete Hamiltonian control (CHC) if (i) arbitrary 
feedback Hamiltonians F E ^(H-i) may be enacted; (ii) 
arbitrary constant control perturbations H c E Sj(Hi) may be 
added to the free Hamiltonian H. 

As we shall see, this leads to both new insights and 
constructive control protocols for systems where the noise 
operator is a generalized angular momentum-type observable, 
for generic finite-dimensional systems. While assuming that 
the implementation of arbitrary coherent Hamiltonians poses 
no problem is in line with standard universality construc- 
tions for open quantum systems [48], [49], from a physical 
standpoint the CHC assumption is certainly demanding and 
should, as such, be carefully scrutinized on a case by case 
basis. In particular, constraints on the allowed Hamiltonian 
contributions relative to the Lindblad dissipator may emerge, 
notably in so-called weak-coupling limit derivations of Marko- 
vian models [10]. A first, interesting consequence of assuming 
CHC emerges directly from the following observation: 

Lemma 2: The Markovian generator 

j t p t = -i[H,p t ]+J2 V ( L k>Pt) (38) 

k 

is equivalent to 

^pt = -i[H + H a , Pt ] + Y,T>{L kl( H) 1 (39) 

k 

where for all k, and Ck E C: 

L k = L k + Cfel, H c = -i J2(c* k L k - c k L{). (40) 

k 

Proof. Consider k = 1: 

V(L,p) = LpD-~{Dl,p} 

= Lptf-~{tfL,p} + [c*L-cL\p] 

= -i[{ic*L-icl)), p]+V(L,p). (41) 

Notice that i(c*L — cL^) is Hermitian. For k > 1, it suffices 
to add up the correction parts in (|4TT > for different fc's, and use 
the linearity of the commutator. ■ 

Note that for Hermitian L and real c, H c = 0. In general, 
by exploiting CHC, we may vary the trace of the Lindblad 
operators through transformations of the form (l40pj and, if 
needed or useful, appropriately counteract the Hamiltonian 
correction H c with a constant control Hamiltonian. This may 
allow to stabilize subsystems that are not invariant for the 
uncontrolled equation, without directly modifying the non- 
unitary part. In addition to this, restricting to such open-loop, 
constant control Hamiltonians avoids additional difficulties 
which are related to reconcile the Markovian limit with generic 
time-varying perturbations [10], [50]. 

Example 3. Consider a generator of the form: 

j t p(t) = -i[a z ,p(t)\ + (ip(t)Lt _ i {L t£, p{t)} y 

interestingly, this corresponds, in physical terms, to a variation of the local 
oscillator in the optical homo-dyne detection setting [37]. 
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where L = a z + a + . Suppose that the task is to make 
Pd = diag(l,0) invariant. Since Hp = 0, L5 = l,L p = 1, 
invariance is not ensured by the uncontrolled dynamics. Using 
the above result, it suffices to apply a constant Hamiltonian 
H c = —i(L — U) = dy. The desired state turns out to be also 
attractive, see Proposition [7j below. 

C. Pure-state preparation with Markovian feedback: Two- 
level systems 

As mentioned, the problem of stabilizing an arbitrary pure 
state for a two-level atom is discussed in detail in [45] for 
H = a<Ty, M — ^/7(7_, and F = \o~ y , with the Hamiltonian, 
measurement, and feedback strength parameters ( a , 7, A, 
respectively), treated as the control design parameters. In terms 
of a standard Bloch sphere parametrization of the state set, 
p= I/2I2 + l/2(xa x + yoy + za z ), with < \{x,y,z)\ < 1, 
it is proved there that any pure state in the xz plane can be 
made invariant and attractive, with the only exception of the 
states on the equator of the sphere. The possibility of relaxing 
the perfect detection assumption is also addressed. 

Our perspective differs not only because we mainly focus 
on continuous measurement of Hermitian spin observables, 
but more importantly because we start from identifying what 
constraints must be imposed to a Lindblad equation for a two- 
dimensional system as in §2^ for ensuring that one of the 
system's pure states is an attractive equilibrium. Without loss 
of generality, let such a state be written as pd = diag(l,0), 
and write, accordingly, 

L k =() k > S Y P ), H=( h J M. 

\ tfe,Q lk,R J \ n p tlR J 

Proposition 7: The pure state pd — diag(l,0) is a glob- 
ally attractive, invariant state for a two-dimensional quantum 
system evolving according to (O iff: 

ihp-\j2 l tslk,p = 0, (42) 

h,Q = 0, Vfc, (43) 
and there exists a k such that 1% P 7^ 0. 

Proof. Eqs. d42l-d43l imply the invariance conditions of 
Corollary Q] hence pd is stable. For the choice = 
diag(/5 fe, ln t k), every diagonal state would clearly be station- 
ary (directly from the form of £(•), or by Proposition |3). 
Hence it must be lp^ ^ for some k. To prove that pd is the 
only attractive point for (O, it suffices to note that ^ 
is the two-dimensional version of the sufficient condition for 
attraction given in Corollary [6] ■ 

Remark: Observe that, even if pd is stable for the un- 
conditional, averaged dynamics over the trajectories of d33l . 
because it is pure it cannot be obtained as a convex combi- 
nation of other states. Thus, pd must be the asymptotic limit 
of each trajectory with probability one. In fact, any invariant 
set different from pd alone could not have it as average. We 
provide next a characterization of the stabilizable manifold. 

Proposition 8: Assume CHC. For any measurement oper- 
ator M, there exist a feedback Hamiltonian F and a Hamil- 
tonian compensation H c able to stabilize an arbitrary desired 



pure state p d for the FME fl37T l iff 

\p d ,(M + M*)] 7^0. (44) 

Proof. Consider as before a basis where pd = diag(l,0), and 
let M H and M denote the Hermitian and anti-Hermitian part 
of M, respectively. By d44b . M H cannot be diagonal in the 
chosen basis. In fact, assume M H to be diagonal, then, by 
Proposition [71 M s — F must be brought to diagonal form to 
ensure invariance of pd- Hence, by the same result, it follows 
that pd cannot be made attractive. However, if M H is not 
diagonal, we can always find an appropriate F in order to 
get an upper diagonal L = M H + i(M s - F), and W = 
H + (FAI + M+F)/2. To conclude, it suffices to devise a 
compensation Hamiltonian H c such that the condition i(H' + 
H C ) P — \l* s lp — is satisfied. ■ 

The above proof naturally suggests a constructive algorithm 
for designing the feedback and correction Hamiltonian re- 
quired to stabilize the desired state. From our analysis, we also 
recover the results of [45] recalled before. For example, the 
states that are never stabilizable within the control assumptions 
of [45] are the ones commuting with the Hermitian part of 
M = a + , that is, M H — a x . On the xz plane in the Bloch's 
representation, the latter correspond precisely to the equatorial 
points. The following example serves to illustrate the basic 
ideas we shall extend to the d-level case. 
Example 4: The simplest choice to obtain an attractive gen- 
erator is to engineer a dissipative part determined by L = 
°+ = (do)' Let i? = n l 2 + n x a x + n y a y + n z a z , with 
no,n x ,n y ,n z G K. Consider e.g. M = \a x and F = ~\cr y . 
Notice that in this case \(FM + M^F) = 0, thus H' = H. 
Substituting in the FME d37l i. one clearly obtain the desired 
result, provided that H c — ~n x <r x — n y a y . 

The spin measurement models considered above have been 
already exploited for stabilization problems (see e.g. [43]), 
although in the context of strategies necessitating a real- 
time estimate of the state [12] - so-called Bayesian feedback 
techniques in the physics literature [46]. Assume that it is 
possible to continuously monitor a single observable, e.g. a x in 
the above example. Since the choice of the reference frame for 
the spin axis is conventional, by suitably adjusting the relative 
orientation of the measurement apparatus and the sample, it is 
then in principle possible to prepare and stabilize any desired 
pure state with the same control strategy. 

D. Extension to multi-level systems 

The previous two-dimensional results naturally extend to 
generic d-level systems. This will also provide an example 
of an attractive state, which does not satisfy the sufficient 
condition of Proposition [6] Let the pure state to be FME- 
stabilized be written as pd — diag(l,0, ... ,0). Under CHC, 
we may without loss of generality assume H to be diagonal 
in this basis. 

Proposition 9: The pure state pd is a globally attractive, in- 
variant state for the FME d37l ) conditioned over the continuous 



13 



measurement of the operator: 
/ mi 



\ 



mi 



m d -i 

V m d _! / 

and a Markovian feedback Hamiltonian: 

/ mi \ 

-mi 



F= 2 



rrid-i 
-m d -i / 



with rrii ^ 0, for i = 1, . . . , (rf — 1). 

Proof. First, observe that L = (Z^.j) = M — iF, the only 
elements different from zero are = m,. By writing p = 

{Pij)i,j=\,...,d, one gets: 



D(L,p) = 4 



/ 



lmip/321 



/ m^mi/922 



m 1 m d -iPd2 


2 



lmi^/912 
2|mi| 2 p 2 2 



m d _ 1 m 1 p 2d ^ 

m^rrid-iPdd 

/ 

|mz-i| 2 pid \ 

• ■ • (|mi| 2 +|m d _i| 2 )p 2 d 



\|m rf _i| 2 pdi (|mi| 2 +|m d _i| 2 )p 



d2 ' ' ' 



2\m d -i\ 2 pdd J 



(45) 

Define = diag[0, 1, . . . , (d— 1)]. Thus, the function Vd(p) = 
tr(Hp) is a valid global Lyapunov function for the target state 
p d in D(Hi) [34]. Indeed, V(p) > and y(p) = iff p = p d . 
Computing Vd{p) = \x{HV(L, p)) using d45l . one obtains: 



MP) =4 



d-l 



- l)|mii| 2 p 4+ i, l+ i 



- i=2 
d-l 

4^|m, 

i=l 



d-l 

J2i\ m n\ 2 Pj+i,3+i 
i=i 



"Pi+l, i+l • 



We conclude by applying Lyapunov stability theorem. Since 
|mij| 2 > and pi,i > 0, the derivative is always non-positive 
and can be zero iff pij =0, i = 2, . . . , d, i.e. p = pd- ■ 
The matrix H in the above proof is essentially a Hamilto- 
nian with energy gaps renormalized to one, whereas F and 
M play a role analogous to the a y and a x observables of the 
d = 2 case. Notice that their form is not different from that 
of standard, higher-dimensional spin observables. 

E. On Markovian-feedback state preparation 

The feedback strategies we consider preserve the Markovian 
character of the open-system evolution. Thus, in a sense, 
the corresponding control problem may then be seen as a 
"Markovian environment design" problem [45] - implying that 
we may write the QDS generator independently of the system 
state. This, along with the remark in Section IIII-CI ensures 



the desired convergence feature for each initial state (in other 
words, robustness with respect to errors in the initial state 
estimation is guaranteed). 

The main advantage with respect to other feedback-design 
strategies is represented by the potential ease in practical 
implementations, since virtually no signal-processing stage 
is required in the realization of the feedback loop. This 
should be contrasted with Bayesian feedback strategies [43], 
[46], whereby an updated state estimate has to be obtained 
through real-time integration of d3~3l , and used to tailor a state- 
dependent feedback action on the underlying evolution. Such 
a task becomes rapidly prohibitive as the dimensionality of the 
target system grows. 

As a potential disadvantage, howewer, the Markovian 
output-feedback we use requires strong control capabilities and 
perfect detection. On one hand, an infinite bandwidth is needed 
to feed back the measurement output in real time. On the other 
hand, both the feedback and measurement parameters have to 
be accurately tuned, along with both the system Hamiltonian 
and its control compensation, if needed. Nevertheless, for state 
stabilization problems, one may assess the role of the perfect- 
detection hypothesis and the possibility to relax it. If r/ < 1, 
the FME is modified as follows [41]: 

j t Pt = T(H+\/2{FM + M^F), Ptj 

+ V(M-iF,p t )+sV(F,p t ), (46) 

where we defined e = (1 — tfj/rj. 

In [10], generators of the form (d}-© are rewritten in a 
convenient way by choosing a suitable Hermitian basis in 
<B(Hi) fa C dxd . In fact, endowing C dxd with the inner 
product (X,Y) := ti-ace(X t F) (Hilbert-Schmidt), we may 
use a basis where the first element is -^Id, and complete it 
with a orthonormal set of Hermitian, traceless operators. This 
can always be done for finite d, for example by employing 
the natural <i-dimensional extension of the Pauli matrices [10], 
[49]. In such a basis, all density operators are represented by 
d 2 -dimensional vectors p = (po, pi, . . . , Pd 2 -i) T , where the 
first component po, relative to ^Id 5 is invariant and equal to 
■^2 f° r TP-dynamics. Let p v — (pi, . . . , p^-i) 7 Hence, any 
QDS generator C{p) must take the form: 



dt 



P : 









c 


D 



1/Vd 

Pv 



(47) 



Assume that the dynamics has a unique attractive state p(°\ 
Thus D must be invertible and we obtain: 
1 ( 1 



Vd V ~ D ~ lc 

Consider now a small perturbation of the generator depend- 
ing on the continuous parameter e, with 1 — 8 < T) < 1, and 
5 sufficiently small so that (D + eD 1 ) remains invertible. The 
generator becomes: 

l/Vd 
Pv 

and the new attractive, unique equilibrium state is: 



dp 







~dt ~ 




D 



' 





a 


D' 



(48) 



Vd{ 



-(D + sD')- x (C + eC) 
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Because is a continuous function of e, we are guaranteed 
that for a sufficiently high detection efficiency the perturbed 
attractive state will be arbitrarily close to the desired one in 
trace norm. Therefore, if we relax our control task to a state 
preparation problem with sufficiently high fidelity, this may 
be accomplished with a sufficiently high detection efficiency, 
yet strictly less than 1. 

Insofar as noise suppression is the intended task, we see how 
monitoring a perfectly dissipative environment may be useful 
for control process. However, the ability to suppress the noise 
source via feedback is necessarily limited by the form of $TJ\ . 
It is apparent that the feedback action is only able to modify 
the skew-Hermitian part of the noise operator L, and even 
in cases where this may suffice, (nearly) perfect detection is 
needed. Nonetheless, Markovian feedback may prove to be 
extremely interesting when only partial noise suppression is 
considered, for instance in order to achieve longer coherence 
times. In this spirit, we turn to analyze how our techniques 
may be employed to synthesize DFSs or NSs in the Markovian 
limit where open-loop control is not an option. 

F. DFS synthesis with Markovian feedback 

As remarked, the feedback loop can only modify the skew- 
Hermitian part of the measurement operator M, which im- 
poses strict constraints on the non-unitary generators that are 
able to be synthesized. A natural question is to what extent we 
might be able to generate DFSs or NSs by closed-loop control. 
In the single-observable feedback setting under examination, 
the DFS notion turns out to be appropriate. 

Theorem 5: Let p = d/2, if d is even, p = (d + l)/2, 
if d is odd, and assume CHC for d37V Then a DFS of (at 
least) dimension p can be generated by Markovian feedback 
for every measurement operator M. 

Proof. A DFS for ( l37| > can be generated, under CHC hypotesis, 
iff there exist a choice of basis such that: 

L = M-iF = 



cIdfs 


P 





R 



Re(c)I D FS 


P/2 


pr/2 





lm(c)l DFS 


-iP/2 ' 


iFt/2 


R A 



where we have decomposed L into Hermitian (H) and skew- 
Hermitian (A) parts as before. The skew-Hermitian part can 
be arbitrarily modified under CHC hypothesis, by choosing 
the appropriate F, Thus, it remains to prove that there exists 
a basis where M H has the form of L H above, and the block 
proportional to the identity is (at least) p-dimensional. M H 
is indeed Hermitian, and can be diagonalized. Let D H be the 
diagonal matrix of the (real) eigenvalues of M H . Then we are 
looking for a U and a Hilbert space decomposition such that: 

= UD H U^ 



Real(c)Ws 


P/2 


Pt/2 


R H 



Udfs 


Up \ 


1 DFS 





Uq 


U R ) 


\ o 


D H r 



u DFS 


a- 


up 





Hence, we want to find p orthonormal vectors to stack in 
(Udfs U p )^ such that: 



Udfs \ Up ) 



DFS 








D H r 



U 



t 

DFS | 



= C Si-DFS, 



with d G M. This is equivalent to ask that the compression 
of M H to some subspace is equivalent to a scalar matrix. 
Let Ui, U2 be normalized eigenvectors of M H of eigenvalues 
di, g?2, respectively. Then by taking u-j = au\ + (3u2, such 
that \a\ 2 + \/3\ 2 — 1, we can construct a vector that is an 
eigenvector of M H restricted to the one-dimensional subspace 
generated by itself. 1*3 has then eigenvalue |a| 2 c?i + |/3| 2 c?2, 
a convex combination of the former eigenvalues di, c?2- Take 
the diagonal elements of D H in descending order, and pair 
the first with the last, the second to last but one, and so on. If 
d is odd, the eigenvalue in the middle will remain unpaired. 
Thus, from these pairs and the respective eigenvectors we can 
then obtain p new vectors as illustrated above, which are all 
eigenvectors of M H restricted to their linear span, with the 
same eigenvalue (in general, d will be a convex combination 
of the two middle eigenvalues. For odd d, it will be the middle 
eigenvalue). From the resulting linear span, we can then obtain 
the desired DFS, by choosing a feedback Hamiltonian F such 
that the Q block of M — iF is zero. ■ 

Remarks: Note that the above proof provides a constructive 
algorithm for generating the DFS. The result is potentially 
useful in light of ongoing efforts for efficiently finding quan- 
tum information-preserving structures [4], [23], [51]. Both the 
CHC assumption and the ability to perfectly monitor the noise 
channel are demanding for present experimental capabilities, 
however the promise of a new technique to generate DFSs 
may prompt further developments in this direction. In par- 
allel, further study is needed in order to weaken the above 
requirements, as it is likely to be possible in specific contexts. 

From another perspective, it is intriguing to compare The- 
orem [5] to the analysis of continuous-time quantum error 
correction presented in [52]. In that case, the target system is 
assumed to be a quantum register, and under the assumption 
that independent errors are occurring on different qubits, a 
Markovian feedback strategy is identified such that the closed- 
loop behavior implements continuous-time quantum error cor- 
rection for a so-called "stabilizer code" [2]. This may be seen 
as equivalent to the generation of a DFS able, in particular, 
to encode (n — 1) logical qubits in a 2™ dimensional space. 
Even if our analysis follows different lines, the setting for our 
DFS -generation problem is similar, and our result consistently 
leads to the same encoding efficiency for d — 2™ - provided 
we can compound the noise effect in a single measurement 
operator. Interestingly, no assumption is made at this stage on 
the structure of the Hilbert space, neither do we impose any 
constraint on the form of the "error", that is, the measurement 
or noise operator in our case. 

Before concluding, we present a simple example of gen- 
eration of attractive DFS for coupled qubits via Markovian 
feedback, which further illustrates some of our results. 

Example 4. Consider H = H q <g> Tt q , TL q = span{|0), |1)}, 
and a controlled closed-loop evolution driven by (T37b . with 
H diagonal and M = a x <g> a x . Assume that we are able to 
monitor M and actuate the feedback Hamiltonian F = —a y ® 
(7 x . Then L = M — iF = 2er_ <E> a x . If we consider Udfs = 
span{|0)(g>|0), |0)<8>|1)}, we obtain block-decomposition of the 
form Q, where L is such that Lops = 0, Lq = 0, Lp = a x . 
Hence, by Corollary [3] Hdfs is a DFS and by Corollary [6] 
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we can prove it is attractive. Notice that the noise operator 
M = a x ® a x does admit noiseless subspaces, e.g. H.' DFS — 
span(|+) ® |+), |+) ® |-)), with |±) = 1/V2(|0) ± |1)), but 
by Proposition [3] none of them can be attractive. This shows 
how the feedback-generated noiseless structure may offer an 
advantage with respect to existing ones. 

IV. Discussion and Conclusion 

We have revisited some fundamental concepts about Marko- 
vian dynamics for quantum systems and restated the notion 
of a general quantum subsystem in linear-algebraic terms. 
A system-theoretic characterization of invariant and noiseless 
subsystems for Markovian quantum dynamical systems has 
been provided, with special attention on key model-robustness 
issues relevant for practical applications. In particular, we 
have showed that, in order to avoid situations where only 
fine-tuning of the Hamiltonian and dissipative terms would 
ensure invariance of a given subsystem, condition (V2\ must 
be replaced by the independent conditions ([T3l and (fl4l i. This 
induces similar modifications on NS invariance conditions. 
This part of our work both puts on more rigorous mathematical 
grounds and completes the existing literature on the subject. 

When imperfect subsystem initialization is considered, the 
conditions to be imposed on the Markovian generator become 
more demanding, which motivates the new notion of asymptot- 
ically stable attractive subsystem. Interestingly, the possibility 
that the noise action may be useful or necessary for remaining 
in the intended subsystem has been independently considered 
before for specific QIP settings [53]. However, a formal 
generalization of the idea and an analytical study were still 
missing. Our linear-algebraic approach, along with Lyapunov's 
techniques, provides explicit stabilization results which have 
been illustrated in simple yet paradigmatic examples. 

In the second part of the work, the conditions identified 
for subsystem invariance and attractivity serve as the starting 
point for designing output-feedback Markovian strategies able 
to actively achieve the intended quantum stabilization. We 
have completely characterized the state-stabilization problem 
for two-level systems described by FMEs of the form (f3Tb . 
While the analysis assumed perfect detection efficiency, a 
perturbative argument indicated how unique attractive states 
depend in a continuous fashion on the model parameters. Our 
suggested DFS generation strategy is also crucially dependent 
on the perfect detection condition, as otherwise the feedback- 
corrected FME would take the form (|46T >. implying an ad- 
ditional error component due to finite efficiency. Nonetheless, 
the norm of this portion of the noise generator is bounded, and 
tends to zero for r\ — > 1. Therefore, even if the non-unitary 
dynamics cannot be counteracted exactly, the time-scale of the 
residual noise action may still be significantly reduced in the 
desired subspaces for sufficiently high detection efficiency. 

The Markovian, output-feedback techniques we employ 
have also been compared, in terms of robustness features, 
with the Bayesian-feedback approach. A key advantage of 
the Markovian approach lies in its intrinsic design simplicity, 
which makes it possible to avoid a costy real-time integration 
of the feedback-controlled master equation and thereby paves 
the way to implementation in higher-dimensional systems. 



Further work is needed in order to establish completely gen- 
eral Markovian feedback stabilization results, including finite 
detection efficiency and multi-channel continuous monitoring. 
From an algorithmic standpoint, it also appears worthwhile 
to investigate the potential of the linear-algebraic approach 
in problems related to finding NSs for a given generator, 
either under perfect or imperfect knowledge. Among the most 
interesting perspectives, additional investigation is certainly 
required to establish the full power of Hamiltonian control and 
Markovian feedback in generating NS structures. This may 
point to new venues for producing protected realizations of 
quantum information for physical systems whose dynamics is 
described by quantum Markovian semigroups. 
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